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Abstract. The aim of this article is to refine a weak invari- 
ance principle for stationary sequences given by Doukhan & Louhichi 
(1999). Since our conditions are not causal our assumptions need to be 
stronger than the mixing and causal 6-weak dependence assumptions 
used in Dedecker & Doukhan (2003). Here, if moments of order > 2 
exist, a weak invariance principle and convergence rates in the CLT 
are obtained; Doukhan & Louhichi (1999) assumed the existence of 
moments with order > 4. Besides the previously used r|- and K-weak 
dependence conditions, we introduce a weaker one, X, which fits the 
Bernoulli shifts with dependent inputs. 
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1. INTRODUCTION 

Let (X t ) te z be a real- valued stationary process. A huge amount of applications 
make use of such times series. 

Several ways of modeling weak dependence have already been proposed. One 
of the most popular is the notion of mixing, see [9] for bibliography; this notion 
leads to a very nice asymptotic theory, in particular a weak invariance principle 
under very sharp conditions (see [26] for the strong mixing case). Such mixing 
conditions entail restrictions on the model. For example, Andrews exhibits in [1] 
the simple counter-example of an auto-regressive process which does not satisfy 
any mixing condition and innovations need much regularity in both MA(oo) and 
Markov models. Doukhan & Louhichi introduced in [7] new weak dependence 
conditions in order to solve those problems. We intend to sharpen their assump- 
tions leading to a weak invariance principle. 

A common approach to derive a weak invariance principle for stationary se- 
quences is based on a martingale difference approximation. This approach was 
first explored by Gordin in [14]; necessary and sufficient conditions were found by 
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Heyde in [15]. Let <M t be a filtration. Heyde's martingale difference approximation 
is equivalent to the existence of moments of order 2 and 

oo oo 

(1.1) £E(X f |sW ) and £(X_ r -E(X_,|ar )) converge in L 2 . 

f=o r=o 

Martingale theory leads directly to invariance principles (see also [27]). In the 
following, the adapted case refers to the special case where X t is 5W r measurable. 
The natural filtration is written as M, = a(Y{,i ^.t) for independent and identically 
distributed inputs (Y) te z; thus X t can be written as a function of the past inputs: 

(1.2) X t =H(Y t ,Y t -i,...). 

Then only the first series in (1.1) needs to be considered. Using the Lindeberg 
technique, Dedecker & Rio relax (1.1) in [6]. Bernstein's blocks method allowed 
Peligrad & Utev to also improve on (1.1) in [22]. Such projective conditions are 
related to dependence coefficients; Dedecker & Doukhan obtain shaip results for 
the causal 8-dependence in [5] and Merlevede et al. address the mixing cases in a 
nice survey paper [20]. 

Martingale difference approximation is not always easy, for instance in the 
particular case where a natural filtration does not exist. The most striking example 
is given by associated sequences (X t ) t& z. Let us recall this notion. A series is said 
to be associated if Cow (f\,f 2) ^ for any two coordinatewise nondecreasing func- 
tions f\ and f2 of (X tl , . . . , X tm ) with Var(/i ) + Var(/2) < °°- However, Newman 
& Wright obtain in [21] a weak invariance principle under the existence of second 
order moments and 

(1.3) G 2 = £Cov(X ,X,)<oo. 

Theorems 2.1 and 2.2 propose invariance principles under general assumptions: 
they apply to the non-causal Bernoulli shifts with weakly dependent inputs (Y t ) te z, 

(1.4) X t =H(Y t - j jeZ). 

Heredity of weak dependence through such non-linear functionals follows 
from a new X-weak dependence property; a function of a X-weak dependence pro- 
cess is X-weakly dependent, see Section 3.2. Analogous models with dependent 
inputs are already considered by [3]. If X t = L/ e z 0C/7 f _ y, Peligrad & Utev prove 
in [23] that the Donsker invariance principle holds for X as soon as it holds for 
the innovation process Y . The non-linearity of H considered here is an impor- 
tant feature which has not been frequently discussed in the past. The condition of 
moments with order > 4 on the observations needed in [7] is reduced to a one of 
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moments with order > 2 and the results rely on specific decays of the dependence 
coefficients. We do not reach the second order moment condition of [15] (or pro- 
jective conditions) and [21]. We conjecture that some times series satisfy weak 
dependence conditions with fast enough decay rates in order to ensure a Donsker 
type theorem but they do not satisfy neither condition (1.1) nor other projective 
criterion (see [20]) nor association nor Gaussianity. More general models (1.4) are 
considered here while causal models (1.2) fit to the adapted case and to projec- 
tive conditions. However, proving this conjecture is really difficult since condition 
(1.1) has to be checked for each a-algebra 5W"o- 

The paper is organized as follows. In Section 2 we introduce various weak 
dependent coefficients in order to state our main results. Section 3 is devoted to 
examples of weak dependent models for which we discuss our results. We shall 
focus on examples of X-weakly dependent sequences. Proofs are given in the last 
section; we first derive conditions ensuring the convergence of the series a 2 . A 
bound of the A-moment of a sum (with 2 < A < m) is proved in Section 4.2; this 
bound is of an independent interest since eg. it directly yields the strong laws of 
large number. The standard Lindeberg method with Bernstein's blocks is devel- 
oped in Section 4.3 and yields our versions of the Donsker theorem. Convergence 
rates of the CLT are obtained in Section 4.4. 



2. DEFINITIONS AND MAIN RESULTS 



2.1. Weak dependence assumptions. 

Definition 2. 1 (Doukhan & Louhichi, 1999). The process (X t ) te z is sa id to be 
(s,\|/)-weakly dependent if there exist a sequence e(r) [ (as r f oo) and a function 
\|/ : N 2 x (R+) 2 -» R+ such that 

\Cov(f(X Sl ,. . . ,Xj,g(X tl , .. . ,X tv )\ < \|/( M ,v,Lip/,Lipg)e(r), 

for any r ^ and any (u + v)-tuples such that si ^ • • • ^ s u ^ s u + r ^ t\ ^ • • • ^ t v , 
where the real valued functions f,g are defined respectively on R" and R v , satisfy 
||/||oo ^ 1, ||g||co ^ 1 and are such that Lip/ + Lip g < oo where 

y • , \f{x\,...,x ll )-f(y u ...,y u )\ 

Lip/= SUp : : : : 

(*!,... ,.y„)^(vi,...,v„) fi -yiH 1- \ x u-yu\ 

Specific functions \|/ yield notions of weak dependence appropriate to describe 
various examples of models: 

• K-weak dependence for which \|/(w, v, a, b) = uvab, in this case we simply 
denote e(r) as K(r); 
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• k' (causal) weak dependence for which \\r(u,v,a,b) = vab, in this case we 
simply denote e(r) as K'(r); this is the causal counterpart of K coefficients 
which is recalled only for completeness; 

• rj-weak dependence, v,a,b) = ua + vb, in this case we write s(r) =r|(r) 
for short; 

• 8-weak dependence is a causal dependence which refers to the function 

v,a,b) = vb, in this case we simply denote s(r) = 6(r) (see [5]); this is 
the causal counterpart of r\ coefficients which is recalled only for complete- 
ness; 

• X-weak dependence v,a,b) = uvab + ua + vb, in this case we write 
e(r)=Mr). 

Remark 2. 1 . Besides the fact that it includes r\ and K-weak dependences, this 
new notion of X-weak dependence will be proved to be convenient, for example, 
for the Bernoulli shifts with associated inputs (see Lemma 2.1 below). 

Remark 2.2. If functions / and g are complex-valued, the previous inequal- 
ities remain true if we substitute e(r)/2 to e(r). A useful case of such complex- 
valued functions is f(x\ ,x u ) = exp (it(x\ H \-x u )) for each t G M, u G N* and 

(aci , ,x u ) G R™ (see Section 4.3). This indeed corresponds to the characteristic 

function adapted to derive the convergence in distribution. 

2.2. Main results. Let (X t ) te z be a real-valued stationary sequence of mean 
satisfying 

(2.1) IE|Xo| m < °°- for a real number m > 2. 
Let us assume that 

(2.2) a 2 = £ Cov(X ,X k ) = £ EXoX k ^ 0. 

keZ keZ 

Denote by W the standard Brownian motion and by W n the partial sums process 

i [nt] 

(2.3) W n (t) = — for t G [0,1], n > 1. 



We now present our main results, which are new versions of the Donsker weak 
invariance principle. 

Theorem 2.1 (K-dependence). Assume that the 0-mean K-weakly dependent 
stationary process (X t ) te z satisfies eqn. (2.1) and K(r) = o(r~ K ) (as r f oo) far 
K > 2 + ^2 tnen me previous expression a 2 is finite and 

W n (t) —> cW(t), in the Skorohod space D([0, 1]). 

n— »<=o 
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Remark 2.3. Under the more restrictive k' condition, Bulinski & Sashkin ob- 
tain invariance principles with the sharper assumption k' > 1 + -^K^ m [4]- Our loss 
is explained by the fact that K'-weakly dependent sequences satisfy K ; (r) ^ Ls^rKs- 
This simple bound directly follows from the definitions. 

The following result relaxes the previous dependence assumptions at the price 
of a faster decay of the dependence coefficients. 

Theorem 2.2 (X-dependence). Assume that the O-mean X-weakly dependent 
stationary inputs satisfies eqn. (2.1) and X(r) = o(r~^) (as r f °°)for X > 4+ 
then a 2 is finite and 

W n (t) aW(t), in the Skorohod space D([0, 1]). 

n— **> 

Remark 2.4. We do not achieve better results for T| or 9-weak dependence 
cases than the one for X— dependence. In comparison with the result obtained by 
[5], our results are not as good under 6- weak dependence. We work under more 
restrictive moment conditions than these authors. The same remark applies for all 
projective measures of dependence; here, we refer to results by [15], [21], [6] and 
[22]. 

Remark 2.5. However, the example of Section 3.2 stresses the fact that such 
results are not systematically better than those of Theorem 2.2; for such general 
examples, we even conjecture that theorems of [15], [21], [6] or [22] do not apply. 

Remark 2.6. The technique of the proofs is based on the Lindeberg method. 
In fact, we prove that |E (<ty(S n /y/n) — ty(oN))\ = o («~ c ) denotes here the char- 
acteristic function) for < c < c* where c* depends only on the parameters m and 
K or X respectively. If m and K (or X) both tend to infinity, we notice that c* — > ^. As 
K or X tends to infinity and m < 3, c* always remains smaller than (m — 2)/ (2m — 2) 
(see Proposition 4.2 in Section 4.4 for more details). 

Remark 2.7. Using a smoothing lemma also yields an analogous bound for 
the uniform distance 

= o(n~ c ), for some c < c' . 

A first and easy way to control d is to let d = c* /4 but the corresponding rate 
is a really bad one (see e.g. in [8]). The Essen inequality holds with the optimal 
exponent i in the independent and identically distributed case (see [24]) and [26] 
reaches the exponent | in the case of strongly mixing sequences. In Proposition 
4.2 of Section 4.4, we achieve d > c*/4. Analogous results have been settled in 
[10] for weakly dependent random fields. Previous results by [15], [21], [6] or [22] 
do not derive such convergence rates for the Kolmogorov distance. 



sup 



/—Sn 

\ n 



'(cN^x) 
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Let us denote by = U/>o G R Z / z% = 0, |/| > /}, the set of finite se- 
quences of real numbers. We consider functions H : — > R such that if x, y E 
R( z ) coincide for all indexes but one, let say jGZ, then 

(2.4) \H(x)-H(y)\^h s (\\z\\ e Vl)\x s -y s \ 



where z £ R w is defined by z. v = and = = if i ^ s. Here p|| 
In Section 3.2, we prove the existence of X„ = lim/_ > oo//((y n -;'l{;'^/});ez) where 
(J t )tei is a weakly dependent real-valued input process. We denote this process by 
X n = H(Y,,-j,j E Z) for simplicity and we derive its X-weak invariance properties. 
Various asymptotic results follow, among which our weak invariance principle, 
Theorem 2.2. 

Corollary 2.1. Let (Y t ) te i be a stationary X-weakly dependent process (with 
dependence coefficients Xy(r)) and H : M.^ — > R satisfying the condition given 
by (2.4) for some I 0. Lef assume that there exist real numbers m, m! with 

E|y r' < °° ^ m > 2 m ' ^ + i ) m - 

r/ie?i X„ = H(Y n -i,i G Z) ex/sfa ctra<f satisfies the weak invariance principle in 
the following cases: 

• Geometric case: b r ^ Ce~ fo ''"' anJ Xy(r) ^ De~ ar for a,b,C,D > 0. 

• Riemannian case: If b r ^ C(l + |r|)~*/or some o > 2 an J X,y(r) ^ Dr~ a 
/or a, C, D > w/f/i 

(2.5) a > i±£(4+-?-Y sf £ = 0, b>l; 
b — 1 \ m — 2 J 



(b-2)(m' -\-£) \ m 

Remark 2.8. The previous conditions are also tractable in the mixed cases. 
We explicitly state them for i > 0: 



m' — 1 -I- £ ( 2 \ 

b r ^ Ce- h \'\ Wr) sC Dr~ a , if moreover a > — —- 4+ 

m — 1 — £ \ m — 2 J 

b,C,D>0. 

6 m _ in 

< C|r|- fc and X Y (r) ^ De^, for a,C,D > with 6 > . 



and 



EXAMPLES 



Theorem 2.1 is useful to derive the weak invariance principle in various cases. 
This section is aimed at a detailed treatment of the Bernoulli shifts with dependent 
inputs. The important class of Lipschitz functions of dependent inputs is presented 



Invariance principle for weakly dependent stationary models 



7 



in a separate section. The importance of our results is highlighted by the models 
of the first subsection. More general non-linear models are considered in the sec- 
ond subsection. Some of those examples illustrate the conjecture we made in the 
introduction but we were not able to formally prove it. 

3.1. Lipschitz processes with dependent inputs. Consider Lipschitz functions 
H : IR( Z ) — > R, i.e. such that eqn. (2.4) is satisfied for I = 0. A simple example of 
this situation is the two-sided linear sequence 



(3.1) 



£ ttiYt-i 



with dependent inputs (Y t ) te i- As quoted by [17] for the case of linear processes 
with dependent input there exists a very general solution; essentially any Donsker 
type theorem for the stationary inputs implies the central limit theorem for any 
linear process driven by such inputs. More precisely, Theorem 5 of [23] states that 
this process even satisfies the Donsker invariance principle if J^- \ aj\ < °°. 

A simple example of Lipschitz non-linear functional of dependent inputs is 



(3.2) 



X, 



■ E 



In this case the inequality (2.4) holds with £ = and b r ^ |oc r |. 

Another example of this situation is the following stationary process 

X t = Y, (^a + £ ajY^^j - EY t (a + £ aj Y t _)j , 

where the inputs (Y t ) te z w& bounded. In this case, the inequality (2.4) also holds 
with £ = and b s ^ 2||7o||oo|a s |. 

To apply our result, we compute the weak dependence coefficients of such 
models. 

Lemma 3.1. Let (Y t ) te z be a strictly stationary process with a finite moment 
of order m ^ 1 and H : — ► R satisfying the condition (2.4) for £ = and some 
nonnegative sequence (b s ) se z such that L = < °°- Then, 

• the process X n =H(Y n -j,j E Z) := limj^ooH (Y n ^jl^j^jj JsZ) is a strictly 
stationary process with finite moments of order m. 

• if the input process (Y t ) te i is X-weakly dependent (the weak dependence 
coefficients are denoted by Xy(r)), then (X t ) te z is X-weakly dependent with 



inf 

2r<k 



2 £ ^||F ||i + (2r+l) 2 L 2 X y (^-2r) 
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• if the input process (Y t ) tE % is r\-weakly dependent (the weak dependence 
coefficients are denoted by r\y(r)) then (X t ) te i is r\-weakly dependent and 



r\ (k) = inf 

2r<k 



2 £ 6i||y ||i + (2r+l)LTi r (*-2r) 



Remark 3.1. Let (Y t ) te z be a strictly stationary process with a finite moment 
of order m > 2. If L = |(X;| < °°, the process X„ = Y,jeZ a jY n -j is a strictly 
stationary process with finite moments of order m which satisfies the assumptions 
of Lemma 3.1 with bj = |0C/|. Even if the weak invariance principle is already 
given in [23] our result is of an independent interest, e.g. for functional estimation 
puiposes. For non-linear Lipschitz functionals it yields new central limit theorems. 

The result of Theorems 2. 1 and 2.2 holds systematically in geometric cases. 
Then it is assumed Riemannian decays, i.e. there exists a,C > such that 

b r < Cr- a . 

The conditions from [15] are compared below with the conditions of Theorems 2. 1 
and 2.2 for specific classes of inputs (Y t ) te z. 

3.1.1. LARCH(oo) inputs. A vast literature is devoted to the study of condition- 
ally heteroskedastic models. A simple equation in terms of a vector- valued process 
allows a unified treatment of those models, see [12]. Let (£, t )tez be an independent 
and identically distributed centered real- valued sequence and a,aj,jE N* be real 
numbers. LARCH(oo) models are solutions of the recurrence equation 



(3.3) r r = ^ffl+£fl#_,j. 

We provide below sufficient conditions for the following chaotic expansion 



(3.4) £ = + £ £ a j&-h a n-- a i&-h--h a \- 

Assume that A = ||£o||mL/>i \ a j\ < 1 then one (essentially unique) stationary solu- 
tion of eqn. (3.3) in L" 1 is given by eqn. (3.4). This solution is 6-weakly dependent 
with 6y (r) ^ Kr l ~" log a_1 r for some constant K > 0. This implies the same bound 
on their coefficients (Xy(r)) r ^o- Condition (2.5) gives the weak invariant principle 
for (X t ) te z under the conditions IE | £,o I < +°° for m > 2, a > 1, and 

1 + a/ 2 

a> - 4 + )+l. 

a - 1 V m— 
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The model (3.1) is also an Heyde's martingale difference approximation (1.1) as 
soon as 

I A /T«?<+ 00 - 

Necessary conditions for weak invariance principle follow as a > 3/2, \aj\ ^ Cj~" 
for some a > 1, E^q < +oo 5 and H^olbL/^i \ a j\ < 1- These conditions are not 
optimal since in this case the process is adapted to the filtration M t = <j(^i, i ^ t). 
Peligrad & Utev extend in [22] the Donsker theorem to the cases where a > 1/2. 
Thus, our conditions are not optimal compared to those of [23] in the linear case 
as in eqn. (3.1). However, for non-linear Lipschitz functional, the result seems to 
be new. 

3.1.2. Non-causal LARCH(oo) inputs. The previous approach extends for the 
case of non-causal LARCH(oo) inputs 

V #o / 

Doukhan et al. prove in [12] the same results of existence as for the previous 
causal case (just replace summation over j > by summation over j / 0) and the 
dependence becomes of the r| type with 

,|W -( lw -X* A ' H,A ^ + ^)" 5clM 

where A{x) = Y,\j\^x \ a j\i A = ||^o||°°E;'^i \ a j\ < 1- (From condition (2.5) the weak 
invariance principle holds for (X t ) te z if ||^o||°° < °°, oc > 1 with 

1 + cc/ 2 \ , 

a> - 4+ +1. 

a - 1 \ m — 2j 

Notice that a very restrictive new assumption is that inputs need to be uniformly 
bounded in this non-causal case. This result is new, a conjecture is that (1.1) does 
not hold. 

3.1.3. Non-causal, non-linear inputs. The weak dependence properties of non- 
causal and non-linear inputs Y t are recalled, see [7] for more details. Let H : 
(W l ) — > R be a measurable function. If the sequence (^ n ) ne z is independent 
and identically distributed on Mr, the Bernoulli shift with input process (^ n )neZ is 
defined as 

Y n =H((^i) ieZ ), neZ. 
Such Bernoulli's shifts are rj-weakly dependent (see [7]) with r\(r) ^ 28[ r / 2 ] if 

(3.5) E\Hgjj£Z)-H^jl m ,.,j£Z)\^b- r . 
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Then condition (2.5) leads to the invariance principle for (X t ) t& z if E|Fo| m < 00 for 
m > 2, a > 1 and 8 r < Kr~ h for 

. 1 + a/, 2 \ 

8> 4+ . 

a - 1 V m - 2 ) 

Conditions (1.1) of [15] do not give clear conditions on coefficients for these mod- 
els. We do not know other weak invariance principle in that general context. 

3.1.4. Associated inputs. A process is associated if Cov (f(Y^),g(Y^)^ ^ 
for any coordinatewise non-decreasing function f,g : W — > R such that the pre- 
vious covariance makes sense with Y^ n ' = (Yi,...,Y„). The K-weak dependence 
condition is known to hold for associated or Gaussian sequences. In both cases 
this condition will hold with 

K(r)=sup|Cov(y ,F;)| 

Notice the absolute values are needed only in the second case since for associated 
processes these covariances are nonnegative. Independent sequences as well are 
associated and Pitt proves in [25] that a Gaussian process with nonnegative co- 
variances is also associated. Finally, we recall that non-decreasing functions of 
associated sequences remain associated. Associated models are classically built 
this way from independent and identically distributed sequences, see [18]. 

Suppose that the inputs (Y t ) te i are such that K(r) ^ Cr~ a (for some a,C > 0). 
For the associated cases and model (3.1), the invariance principle of [21] follows 
from remark of [19] as soon as E7 < +00, a > 1 and a > 1. These conditions are 
optimal, they correspond to Y,jCo\(Xo,Xj) < °°. Such strong conditions are due to 
the fact that zero correlation implies independence for associated processes. Our 
conditions for invariance principle are much stronger: E|F| m < +00 with m > 2, 
a > 1 and 

1 + a/ 2 \ 

a > 4 + . 

a - 1 V m-2) 

For non-linear Lipschitz cases as in eqn. (3.2) the result seems to be new. In the 
special case of K-weak dependent inputs that are not associated, the optimal weak 
invariance principle of [21] does not apply, see [7] for examples. 

3.2. The Bernoulli shifts with dependent inputs. Let H : — ► R be a measur- 
able (non necessarily Lipschitz) function and X n = H(Y n -i, i £ Z). Such models are 
proved to exhibit either X or rj-weak dependence properties. Because the Bernoulli 
shifts of K-weak dependent inputs are neither K nor rj-weakly dependent, the K case 
is here included in the X one. 
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Consider the non-Lipschitz function H defined by 



In this case, Lemma 3.1 does not apply. To derive weak dependence properties of 
such processes, we assume that H satisfies the condition (2.4) with £ ^ 0, which re- 
mains a stronger assumption than for the case of independent inputs, see eqn. (3.5). 
Relaxing Lipschitz assumption on H is possible if we assume the existence of 
higher moments for the inputs. The following lemma gives both the existence and 
the weak dependence properties of such models 



Lemma 3.2. Let (Fj)igz be a stationary process and H : MS ' — > K satisfies 
condition (2.4) for some £ > and some sequence bj ^ such that £ j \j\bj < °°- 
Let us assume that there exist a pair of real numbers (m,m') with E|Fo| m < °° such 
that m 1 and m' ^ {£ + l)m. Then, 



• the process X n = H(Y n -j,i £ Z) is well defined in L m : it is a strictly station- 
ary process; 

• if the input process (F/)/eZ is X-weakly dependent (the weak dependence co- 
efficients are denoted by Xy(r)), then X„ is X-weakly dependent and there 
exists a constant c > such that 



X(k) = c inf 

r<[*/2] 



£ \j\b j + (2r+\) 2 X Y (k-2r)^ 



i - ' 



\J\>r 



• i/ f/ie irapw* process (Yj)j e z is r\-weakly dependent (the weak dependence 
coefficients are denoted by r\y(r)) then X„ is r\-weakly dependent and there 
exists a constant c > such that 



r\(k) =c inf 

r^[k/2] 



£ |7|^- + (2r+l) 1+ ^Triy(^-2r)^ 



m'-l-f 
-1 



Such models where already mentioned in the mixing case by [2] and [3]. The 
proofs are deferred to Section 4.6. 



3.2.1. Volterra models with dependent inputs. Consider the function H defined 
by 

= £ £ a jl..j k x h---xjk, 

k=0ji,~,jk 
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then if x, y are as in eqn. (2.4) 

H(x)-HM = y y y a f ,. . . x 

/r=l «=1 ;i j„-i 

Ju+i — , A 

x h ' ' ' x ju-i ( Xs ~ys) x iu+\ ' ' ' x jk- 

From the triangular inequality we thus derive that the previous lemma 3.2 may be 
written with £ = K — 1 , 

'Mi « | 



k=\ 

where Yj- k ' s ' stands for the sums over all indices in Z k where one of the indices 
ji , . . . , jk takes on the value s and 



k=0ji,...J k 

For example, j\ ^ C (ji V ■ ■ • V jk) a or Cexp (— a(ji V • • • V jk)) respec- 
tively yield b s ^ C's d ~ l ~ a or b s ^ C'e~ as for some constant C' > 0. 

3.2.2. Markov stationary inputs. Markov stationary sequences satisfy a recur- 
rence equation 

Z n — F (Z n — i , . . . , Z n —(j , ) 

where (^„) is a sequence of independent and identically distributed random vari- 
ables. In this case Y n = (Z„, . . . ,Z„_^ + i) is a Markov chain Y„ = M(F,,_i,^„) with 

(3.6) M(x\,...,x d &) = (F(x u . . . ,x d ,£,),xi, ■ ■ ■ ,*d-i)- 

Theorem 1.IV.24 of [13] proves that eqn. (3.6) has a stationary solution (Z n ) ne z in 
L m for m ^ 1 as soon as ||F(0,^)|| m < °° and there exist a norm || • || on W 1 and a 
real number a € [0, 1[ such that — F(y,^)|| m ^ a\\x — y\\. In this setting 6- 

dependence holds with 0z(?") = 0{a r / d ) (as r j oo). We shall not give more details 
about the significative examples provided in [11]. Indeed, we already mentioned 
that our results are sub-optimal in such causal cases; such dependent sequences 
may however also be used as inputs for the Bernoulli shifts. 

3.2.3. Explicit dependence rates. We now specify the decay rates from Lemma 
3.2. For standard decays of the previous sequences, it is easy to get the following 
explicit bounds. Here b,c,C,D,X,r\ > are constants which may differ from one 
case to the other. 
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• If bj < C(\j\ + \y b and X Y (j) ^ Dj- X , resp. r\ T (J) ^Dj~^ then from a 
simple calculation, we optimize both terms in order to prove that *k(k) ^ 

2\ m'-l-t (»-2)(m'-2) 

cfe v ^^TTf.resp. ri(yt) s^cA: '(MFiH, 

Note that in the case where m! = °° this exponent may be arbitrarily close to 
X for large values of b > 0. This exponent may thus take all possible values 
between and X. 

• If bj < CfH-'l* and X Y (j) ^ De~ 7 '\ respectively r\ Y (j) < 

we obtain 

^ ck 2 e ™K>-'-M)+in(>n'-i-e) , resp. rj(jfc) ^ ciT^^e '''tRwR. 
The geometric decay of both (bj)j e z and the weak dependence coefficients 
of the inputs ensure the geometric decay of the weak dependence coefficients 
of the Bernoulli shift. 

• If we assume that the coefficients (bj)j G z associated with the Bernoulli shift 
have a geometric decay, say bj ^ Ce"^ b and that X Y (j) ^ Dj~ x (resp. 

r\Y{j) ^ D j~"^) we obtain the bounds A,(fc) ^ ck \og z k, resp. r\(k) ^ 

_ r .m / -2 i , £ 
'^Tlog fc. 

If m' = oo tightness is reduced by a factor log 2 k with respect to the depen- 
dence coefficients of the input dependent series (Y t ) te z- 

• If we assume that the coefficients (bj)j e z associated with the Bernoulli shift 
have a Riemannian decay, say bj ^ C(\j\ + \ )~ b and that X Y (j) ^ De^^ 
(resp. T\ Y (j) De~ jr] ) we find X{k) ^ dfe 2- *, resp. t\(k) ^ ck 2 - b . 

All models or functions of models we present here are X-weakly dependent. 
We treat some basic examples in detail when a discussion with other results is pos- 
sible. We believe that for some models, X-weak invariance properties follow from 
easy computations, and then, statistical results like our weak invariance principle. 

4. PROOFS OF THE MAIN RESULTS 

Our proof for central limit theorems is based on a truncation method. For 
a truncation level T ^ 1 we shall denote Xk = fr{Xk) — Kfx(Xk) with fr(X) = 
X V (— T) A T. ^From now on, we shall use the convenient notation a n < b n for 
two real sequences (a n ) ne jq an d {b n )neH when there exists some constant C > 
such that \a n \ ^ Cb n for each integer n. We also remark that Xk has moments of all 
orders because it is bounded. In the entire sequel, we denote = E|Xo| m . For any 
a ^ m, we control the moment E|/r(Xo) —Xq\" with Markov inequality 

E\f T (Xo)-X Q \ a ^E\X Q \ a l mm ^vT a -"\ 
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thus using Jensen inequality yields 

(4.1) liro-Xoll^^r 1 -^. 

Starting from this truncation, we are now able to control the limiting variance as 
well as the higher order moments. 

In this section we prove that the central limit theorems corresponding to the 
convergence W„(l) — > W(l) in both Theorems 2.1 and 2.2 hold and we shall pro- 
vide convergence rates corresponding to these central limit theorems. The weak 
invariance principle is obtained in a standard way from such central limit theorems 
and tightness, which follows from Lemma 3.2, by using the classical Kolmogorov- 
Centsov tightness criterion, see [2]. In the last subsection, we prove Lemma 4.2 
that states the properties of our (new) Bernoulli's shifts with dependent inputs. 

4.1. Variances. 

Lemma 4.1 (Variances). If one of the following conditions holds 

CO 

(4.2) £k(*) < - 

k=Q 

CO 

(4.3) JX*) 5 ^ < 00 

then the series o 2 is convergent. 

Proof. Using the fact that Xo = gr{Xo) is a function of Xq with Lipgr = 1 
snd ||gr||>» ^ 2T, we derive 

(4.4) | Cov(X ,X k )\ < K(Jfc) or {AT + l)X,(Jk), respectively. 
In the K dependent case, the truncation may thus be omitted and 

(4.5) \Cov(X ,X k )\^K(k). 

In the following, we shall only consider X dependence. We develop 

Coy(X ,X k ) = Cov{X ,X k ) + Cov{X Q -X ,X k ) + Cov{X ,X k -X k ). 

We use a truncation T (to be determined) and the two previous bounds eqn. (4.1) 
and eqn. (4.4); then the Holder inequality with the exponents \ja-\- l/m = 1 yields 

\Cov(X ,X k )\ ^ (4r + l)^) + 2||Xo|U|r -Xo|| a 

^ (4r + i)X0t)+4 iU 1 / fl+1 / m r 1 -" , / a 

< (4T + l)X(k)+4fiT 2 - m . 
Chosing T'"^ 1 = n/X{k) we obtain 

(4.6) \Cov(X ,X k )\ ^9fi^X(k)^. 
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4.2. A A-order moment bound. 

Lemma 4.2. Let (X t ) t eZ ue a stationary and centered process. Let us assume 
that E|Xo|" ! < °°, and that this process is either K-weakly dependent with K(r) = 
O (r~ K ) or X-weakly dependent with X(r) = O (r~ x ). IfK>2 + orX>4 + 
then for all A > 2 small enough there exists a constant C > such that 

\\Sn\\A ^ Cy/n. 

Remark 4.1. A G ]2, 2 + A A 5 A 1 [ where A and B are constants smaller than 
m — 2 and depend on m and respectively K or X. Equations (4. 10) and (4. 1 1) precise 
the previous involved constants A and B. 

( 5 \ l/A 

Remark 4.2. The constant satisfies C > I / A _ 2 w 2 ) I Cov(Xo,Xjt)|. 

Under the conditions of this lemma, Lemma 4. 1 entails 

c= £|Cov(X ,X*)| <°o. 

keZ 

Remark 4.3. The result is sketched from [4]. However, their dependence 
condition is of a causal nature while our is not. It explains a loss with respect to 
the exponents X, and K. In their K'-weak dependence setting the best possible value 
of the exponent is 1 while it is 2 for our non-causal dependence. 
Proof of Lemma 4.2. For convenience, let denote in the sequel A = 2 + 8 and 
m = 2 + C,. Like in [16] or [4], we proceed by induction on k for n ^ 2 k to prove 
that 

(4.7) ||l + |5„||| A <Cv^. 

We assume that eqn. (4.7) is satisfied for all n ^ 2 K ~ l . Setting N = 2 K we have 
to find a bound for || 1 + \Sn\ ||a- We can divide the sum Sn into three blocks: the 
first two blocks have the same size n ^ 2 K ~ l and are denoted by Q and R; the 
third block V, located between Q and R, has cardinality q < n. We then have 
II 1 + ISjvIHa ^ || 1 + \Q\ + |^|||a + ||V||a- The term ||V||a is directly bounded by 
II 1 + \y\ II a ^ C^fq from the recurrence assumption. Writing q = N b with b < 1, 
then this term is of order strictly smaller than \/N. For ||1 + \ Q\ + \R\ \\\, we have 

E(i + iei + |/?i) A < E(i + i£i + |tf|) 2 (i + iei + |fi|) 8 , 

^ E(l +2|fi| +2\R\ + (|e| + \R\) 2 )(l + \Q\ + \R\f. 
We expand the right-hand side of this expression; the following terms appear 
• E(l + |<2| + |7?|) 5 ^ l + |G|f + |/?|f < l + 2c 8 (V^) 8 , 
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• E|fi|(l + + \R\) S < E|fi|((l + \R\) 8 + |0| 8 ) 
^E|0|(l + |/?|) 8 + E|<2| 1+8 

The term E| 2| 1+8 is bounded by ||2||^+ 8 andthenby c 1+8 (V«) 1+8 - The term 
E|<2|(1 + \R\) S is bounded by ||2|| 1+S/2II 1 + |#Hli usin g Holder inequality. 
It is at least of order cC 8 (y / «) 1+8 , analogous to the latter one, where we 
exchange the roles of Q and R. 

• E(|(2| + \R\) 2 (l + |0| + \R\f - For this term, we use an inequality from [4] 

E(iei + |/?i) 2 (i + iei + i*i) 8 

<E|£| A + E|7?| A + 5(E£ 2 (1 + |/?|) 8 + E/? 2 (1 + |2|) 8 ). 

Now E|2| A < C A (V«) A is bounded by using eqn. (4.7). The second term is 
its analogous with R substituted to Q. The third term has to be handled with 
a particular care, as follows. 

We use the weak dependence notion to control KQ 2 (l + \R\) S and ER 2 (l + |0|) 8 - 
Denote by X the variable X V T A (-T) for a real T > to be determined later. By 
extension Q and R denote the truncated sums of the variables Xj. We have 

K\Q\ 2 (l + \R\) 6 ^ 

EQ 2 1 \R\ - \R\ 1 8 + E(Q 2 - Q 2 ) ( 1 + |3?| ) 8 + Eg 2 ( 1 + \R\ ) 8 . 

We begin with a control of E<2 2 ||/?| — |/?|| 8 . Using the Holder inequality with 
2/m + l/m' = 1 yields 

EG 2 i|/?i-i^ii 8 ^iieii 2 iiii^i-i^ii 5 i| m ' 

|| Oil a is bounded using eqn. (4.7) and 

\\R\ - \R\f" 1 ' ^ \R\ 8m 'l m>T } ^ |7?| 8m 'l| R | >r . 
We then bound l\ R \ >T < {\R\/T) a with a = m- 8m', hence 

E\\R\-\R\f m ' ^E\R\ m T 6m '- m . 
By convexity and stationarity, we have E|/?| m ^ n m E|Zo| m , so that 
EQ 2 (\R\ - \R\f ± n 2+m/m' T 8-m/m'_ 

Finally, remarking that m / m' = m — 2, we obtain 

EQ 2 (\R\-\R\) S ±n m T A -' n . 
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We get the same bound for the second term 

E(G 2 - <2 2 )(1 + \R\f 1 n m T A - m . 
For the third one, we introduce a covariance term 

E0 2 (1 + |7?|) s ^ Cov(2 2 , (1 + |7?|) 5 ) +E2 2 E(1 + |7?|) 8 . 

The latter is bounded with iQlfJ-^li ^ c A y / « A . The covariance is controlled as 
follows by using weak-dependence 

• in the K-dependent case: n 2 TK(q), 

• in the A-dependent case: « 3 r 2 A(g). 

We then choose either the truncation T m - h - 1 = n m - 2 /K(q) or T m - S = n m - 3 /X{q). 
At this point, the three terms of the decomposition are of the same order 

E|<2| 2 (l + |tf|) s H (« 3 " ! - 2A K(^)" , - A ) 1/(m_8_1) , under K-dependence, 
E|G| 2 (1 + \R\f =< (n 5m - 3A X{q) m - A ) 1/(m_8) , under ^-dependence . 

, 3m-2A+frK(A-m) 

Let q = N , we note that n ^ N/2 and this term is of order N under 

5m-3A+fA(A-m) 

K-weak dependence and the order N under A-weak dependence. Those 

terms are thus negligible with respect to N A I 2 if 

3ib-2A-A/2(jb-8-1) 

(4.8) K> \ -, under K-dependence, 

b(m — A) 

. 5m-3A-A/2(ra-8) 

(4.9) A > -, r , under A-dependence . 

b(m — A) 

Finally, using this assumption, b < 1 and n ^ N/2, we derive the bound for some 
suitable constants a\ ,012 > 

E(1 + |5«|) A ^ (2- h l 2 C A + 5-2- h l 2 c A + ai N- a ^ (VnY. 



Using the relation between C and c, we conclude that eqn. (4.7) is also true at the 
step N if the constant C satisfies 2~ 8 / 2 C A + 5 • 2~ 5 / 2 c A + a x N~ a2 < C A . Choose 



C > ^ 5c ^s/2 i 2 ^ 2 J with c = Jjtez I Cov(XoA)|> then the previous relation holds. 
Finally, we use eqn. (4.8) and eqn. (4.9) to find a condition on 8. 
In the case of K-weak dependence, we rewrite inequality eqn. (4.8) as 

0>5 2 + 5(2k-3-Q-k^ + 2^+1. 



l/A 
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It leads to the following condition on 8 



(410) s< V(2 K -3-Q^ + 4W-2;- 1) + ; + 3-2K A1 ^ 

We do the same in the case of the X-weak dependence 



(4.11) 8< V^-6-^+4W-4C-2) + i ; + 6-2^ 1 ^ Q 

Remark 4.4. The bounds A and B are always smaller than C,. 

4.3. Proofs of Theorems 2.1 and 2.2. Let S = ^S n and consider p = p(n) and 
q = q{n) in such a way that 

Iim4- = lim44 = lim — =0 

and k = k(n) = n/[p(n) +q{n)] 

ieBi 



— (U 1 + -~ + U k ), withU j =Yx i 



where Bj = ](p + q){j — 1), (p + q)(j — 1) +p] n N is a subset of p successive 
integers from {l,...,n} such that, for j / /, Bj and By are at least distant of 
q = q{n) from each other. We denote by B'- the block between Bj and Bj + \ and 
Vy = Y^ieB 1 Xi- Vk is the last block of X, between the end of B^ and n. Furthermore, 
let o 2 p = Var(t/i)/p = I|,-|</,(1 - |i|//>)EXb^, and let 

Y = U[ + " r +U ' k , U'j-^pcl) 

where the Gaussian variables V) are mutually independent and also independent 
of the sequence (X n ) ne z- We also consider a sequence Uf,...,U£ of mutually 
independent random variables with the same distribution as U\ and we let Z* = 

(t/j* H h ^*) /y 7 "- In the entire section, we fix t G R and we define / : R — > C 

by /(x) = exp {/?x}. Then E/(5) - f(oN) = E/(5) - /(Z) + E/(Z) - /(Z*) + 
E/(Z*) - /(F) +E/(7) -f(pN). Lindeberg method is devoted to prove that this 
expression converges to as n — > °°. The first and the last terms in this inequality 
are referred to as the auxiliary terms in this Bernstein-Lindeberg method. They 
come from the replacement of the individual initial - non-Gaussian and Gaussian 
respectively - random variables by their block counterparts. The second term is 
analogous to that obtained with decoupling and turns the proof of the central limit 
theorem to the independent case. The third term is referred to as the main term 
and following the proof under independence it will be bounded above by using 
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a Taylor expansion. Because of the dependence structure, in the corresponding 
bounds, some additional covariance terms will appear. 

The following subsections are organized as follows: we first consider the auxiliary 
terms and the main terms are then decomposed by the usual Lindeberg method and 
the corresponding terms coming from the dependence or the usual remainder terms 
(standard for the independent case) are considered in separate subsections. In the 
last one, we collect these calculations to obtain the central limit theorem. 

4.3.1. Auxiliary terms. Using Taylor expansions up to the second order, we ob- 
tain 

\Ef(S)-f(Z)\ < ||/||JE|S-Z| 
II f"\\ 2 

and \Ef(Y)-f(oN)\ < ^^E|F-aAT| 2 . 

We note that Z — S = (V\ H Wk)/ V™ is a sum of ^;' s for which the number of 

terms is ^ (k+ l)q + p. Then eqn. (4.6) and eqn. (4.5), under conditions (4.3) or 
(4.2) respectively, entail: 

(E|Z-S|) 2 sCE|Z-S| 2 * {{k+l)q + p)/n. 

I rC T) 

Now Y ~ \ — o p N, thus 
V n 



kp 
n 



9 i ? 9 i 



E\Y-oN\ 2 < 

Remarking that \kpjn — 1| 2 < ((& + l)q + p) /n, it remains to bound the quantity 



l°p-° 2 | < £ -\EX Xi\ + £ |EXoX/|. 



p 

\i\<P r W>P 



Let at = |EZoXj|, under conditions (4.3) or (4.2) (respectively), the series £a,- 



i=0 



converge thus s ; = Y" a, — > and 

■ • /— ><*> 

p-l ■ 9 p-l 
i 2 2 1 \ i v t — i 

\o p — G I ^ 2 > — • a,- + 2jp ^ — > + 2.sy 
i=0 ^ P i=Q 

Cesaro lemma entails that term |a 2 — a 2 | converges to 0. 

Hence |E/(5) - /(Z)| + |E/(Y ) - f{oN) | tends to as n | oo. 

To determine the convergence rate, we assume that £?,• = o(i~ a ) for some a > 1; 

then 

| a 2_ a 2|^l-<x 
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Remarking that a\ = EXoX; = Cov(Xo,X,-), we then use equations (4.5) and (4.6) 
and we find a = k or a = X{m — 2)/{m— 1) depending of the weak-dependence 
setting. With p = n a ,q = n b for 2 constants a and b and from the relation ||/(" ||«, ^ 
\t\i, those bounds become, up to a constant 

\t\ (n( fo - a )/ 2 W fl ~ 1)/2 ) +t 2 (n b - a + n a{ -^) , in the K-weak dependence setting, 
\t\ ( n (*- fl )/ 2 + «("-!)/ 2 ) +f 2 ^- fl+n a(i-X( m -2)/(m-i))^ ; for ^-weak dependence. 

4.3.2. Main terms. It remains to control the second and the third terms of the 
sum. They are bounded as usual by 

k k 

|E/(Z) -/(Z*)| < £ |EA y |, |E/(Z*) -/(F)| < £ lEA^I, 

7=1 7=1 

where A ; - = /(W,- + Xj ) -f(Wj +x*), for j = 1, . . . ,* with = 4^, x* = -±UJ, 
Wj = Wj+Zi>jXl wj = Zi<jXi and A'j = f(Wj +x*)-f(Wj forj = l,...,k 

Exploiting the special form of / and the independence properties of the variables 
U* and U[, we can write 

EA y = (Ef(wj)f(xj) - Ef( Wj )Ef(x*)) Ef ^£x? j , 
EA'j = (Ef(x*)-Ef(x'j))Ef(w;). 

We then control the two terms Ef (jl x ^j and E ^ ( W j) h ? the fact that WfW" ^ 1 
and we use the coupling to introduce a covariance term 

|EAy| < 

\EA>\ < 

• For Aj, we use weak dependence. 

To do so, write |EA ; -| = \Cov[F(X m ,m £ B t ,i < j),G(X m ,m £ Bj)]\, with 
F(zi,...,Zk P ) =f{Y J Ui/y/n\ where u t = We verify that 1 



COV / £x; ),f(xj) 



\t<J 



\Ef(x*)-Ef(x'M. 
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and we control LipF: 



1-expif ( -=Y< 

\V n i<Jl&i 



Similarly, for G(zi, . . . ,z p ) = / I E 2 '/ 1 ^ ' wenave II^IU = I and Lip G ^ 



,i=l 



\t\l\fn. We then distinguish the two cases of weak dependence, remarking 
the gap between the left and the right terms in the covariance is at least q. 

- In the K-weak dependent setting: |EAy| ■< hp ■ p ■ 4= • ■ k(#). 

- Under the X dependence condition: 

mj\l(kp-p-$-$+kp-$+p-$)-Hq). 

Note that these bounds do not depend on j: 



\Ef(Z)-f(Z*)\±kp-t 2 -K(q), 

<kp-{t 2 + \t\^/k/^)-X{q), 



under K, 
under X. 



Knowing that p = n a , q = n b , x(r) = O (r~ K ) or X(r) = O (r~^), these con- 
vergence rates respectively become n l ~ Kb or rc 1 +( l / 2 - a )+-^' j n the K or the X 
dependence context. 

For Ay, Taylor expansions up to order 2 or 3 respectively give: 



1/(^-/(^)1 < \x*-*?j\" 
1 



rj < -\\f"\Ux)-^)\ov 



I * — 'I 3 
\Xj Xj\ , 



For an arbitrary 8 € [0, 1], we have: 

Erj * E(? 2 (|x}| 2 + |y/)A|?| 3 (|x5| 3 + |x'/)) 

r< E(f 2 |^| 2 A|f| 3 |A:*| 3 )+E(f 2 |^| 2 A|f|V/) 

|?| 2+S (E|x*| 2+5 + E|x i | 2+s 



22 



P. Doukhan and O. Wintenberger 



By the stationarity of the sequence (Xj)j e z, we obtain 
\EA'j\ H If+V^^EIS^^V;^ 1 



Lemma 4.2 allows us to fin a bound for E|5 , p | 2+S . If K > 2+ I, or X > 4+ i, 
where K(r) = (r~ K ) or X(r) = O (r^) then there exist 8 €]0,£ A 1[ and 
C> such that 

E|5 p | 2+8 ^Cp 1+s / 2 . 

We then obtain 

\Ef(Z*)-f(Y)\^\t\ 2+& k(p/n) i+ V 2 . 

Because p = n a , this bound is of order rc( a_1 ) 8 / 2 m both K and X-weak de- 
pendence settings. 

We now collect the previous bounds to conclude that a multidimensional CLT 
holds under assumptions of both Theorems 2.1 and 2.2. Tightness follows from 
the Kolmogorov-Chentsov criterion (see [2]) and Lemma 4.2; thus both Theorems 
2.1 and 2.2 follow from repeated application of the previous CLT. □ 

4.4. Rates of convergence. Rates of convergence are now presented in two propo- 
sitions of independent interest. We compute explicit bounds for both the difference 
of characteristic functions and the Berry-Esseen inequalities. 

Proposition 4.1. Let (X t ) te z be a weakly dependent stationary process sat- 
isfying eqn. (2.1) with m = 2 + C, then the difference between the characteristic 
functions is bounded by 

for some c < c* and allt Gl where c* depends of the weak dependent coefficients 
• under K-weak dependence, if K(r) = O (r~ K ) for K > 2 + i, then we have 



a+2k(i+a; 



where 



A V(2k-3-Q 2 + 4(k^-2^-1) + ^ + 3-2k ai 

2 



where 



under X-weak dependence, ifX(r) = o(r ^) for X > 4+ |, then we obtain 
° 2 + B + 2X{l+B] 



V(2X-6-Q 2 + 4(^-4^-2) + ^ + 6-2X a 
B= Al, 
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We use the following Essen inequality in Proposition 4.2 

Theorem 4.1 (Theorem 5.1 p. 142 of [24]). LetX and Y be 2 random variables 
and assume that Y is Gaussian. Let F and G be their distribution functions with 
corresponding characteristic functions f and g. Then, for every T > 0, we have 
for suitable constants b and c 



(4.12) sup|F(jc)-G(jc)| O 





m-g(t) 




t 



c 

dt + —. 
T 

Proposition 4.2 (A rate in the Berry Essen bounds). Let (X t ) te z be a real 
stationary process satisfying Proposition 4. 1 assumptions. We obtain 

sup \F n (x) - <E>(x)| = o {n~ c ) 

X 

with c < c' where c' = c*/(3 +A) or c' = c* / (3 + B), respectively, in K or X-weak 
dependence contexts (A, B and c* are defined in Proposition 4.1). 

Proof of Proposition 4.1. In the previous section, the different terms have 
already been bounded as follows: 

• In the K-weak dependence case, the exponents of n in the bounds obtained 
in section 4.3 are 

- for the auxiliary terms: (b — a) /2, (a — l)/2 and ^(l — k), 

- for the main terms: 1 — Kb and (a — 1)5/2. 

Because 8 < 1 and b < a < 1, we remark that (a — 1)8/2 > (a — l)/2 and 
1 — Kb> a(l — k). The only rate of the auxiliary term it remains to consider 
is {b — a)/2 and we obtain 



2 + 8 + 2k8 
8 + 2k(1 + 8) £ 



b* 



'1 + 8 



„ 2 + a* n 
" = TT2K- e] °' a 



We conclude with standard calculations and with the help of the inequality 
8 < A (see eqn. (4.10)). 

We have the equivalent in the X-weak dependence case 

- for the auxiliary terms: (b — a) /2, (a — l)/2 and a(l — X), 

- for the main terms: 1 + (1/2 — a) + — Xb and (a — 1)8/2. 

Only three rates give the asymptotic: [a — 1)8/2, l + (l/2 — a) + — \b and 
(b — a)/2. In the previous case, the optimal choice of a* was smaller than 
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1/2. Then we have to consider here the rate 3/2 — a — Xb and not 1 — Xb. 
Thus 



3 + 8 + 2X8 
2 + 8 + 2^(1 + 8) 

3 + 28 
2 + 8 + 2^(1 + 8) 



b 



' 1 + 8 



e ]0, a* 



Finally, we obtain a rate of using the inequality eqn. (4.11). ■ 

Proof of Proposition 4.2. Let choose a* and b* as in the proof of propo- 
sition 4.1. We now need to make precise the impact of t on the different term 
of the bound of the L 1 distance between the characteristic functions of 5 and 
ON. Up to a constant independent of t, the Kolmogorov distance is bounded by 
( |/| + 1 2 + \ t | 2+c ) rT c * . Here C = A or B in the two contexts of dependence. Using 
Theorem 4.1 for a well chosen value of T , we obtain the result of proposition 4.2. 



4.5. Proof of Lemma 3.1. The case of Lipschitz functions of dependent inputs 
is divided in two sections devoted respectively to the definition of such models and 
to their weak dependence properties. 

4.5.1. Existence. Let F« = (F_fl W< ,) iGZ , Y? = {Y-(l - s <i^ s ) i€ Z for j£Z and 
H (y(°°)) = Xim^ooH (yW). In order to prove the existence of the Bernoulli shift 
with dependent inputs, we show that Xo is the sum of a normally convergent series 
in L m ; formally 



X = H(Y^) =H(0) + [H(Y^) -H(0) 

oo 

+ £ff (y(H-i)) -H(yI s) ) + (h(Y®) -H(Y® 



^From eqn. (2.4) we obtain 

h(y^) -H(0) 



h(yW]-h(y® 



H Y 



+v) 



H Y 



-CO 



^ &oIkoIU) 

< h \\Y II 



By (Y t )tez's stationarity we get 



(4.13) \\Xo\\ m < 



h(yW)-h{0) +£ 



s=l 



h(y^ +1 A-h(y{ s) 



+ 



Invariance principle for weakly dependent stationary models 



25 



Analogously, the process X t = H(Y t -j,i G Z) is well denned as the sum of a nor- 
mally convergent series in L m . The stationarity of (X t ) te z holds from that of the 
input process (Y t ) teZ . 

4.5.2. Weak dependence properties. Let X„ (r) = H(Y^) and X s = (X Sl ,X Su ), 
Xt = {X tl ,X tr ) for any k ^ and any (u + v) -tuple such that s\ < ■ ■ ■ < s u ^ 
s u + k ^ t\ < ■ ■ ■ < t v . Then we have for all f,g satisfying \\f\\<*>, \\g\\oo ^ 1 and 
Lip/ + Lipg < oo 

|Cov(/(X s ),g(X t ))| < \Cov(f(X s )-f(X^ r) ),g(X t ))\ 



(4.14) 



+ \Cov(f(X^),g(X t )-g(Xi r> ))\ 



(4.15) 
(4.16) 

Using the fact that \\g\\oo ^ 1, we bound the term in eqn. (4.14) 



(r 



+ |Cov(/(X s W U(X t W ))|. 



2Lip/-E 



I(Xv,-x 



i=] 



< 2wLip f max E 

l<i<u 



X s -X^ 



(r) 



(r) 



Applying inequality (4.13) in the case where m = 1, we obtain E 
L;>r^! I l^b 1 1 1- The second term (4.15) is bounded in a similar way. 
The last term (4.16) can be written as 

Cov(F^(Y Si+j , 1 ^ i < u, \j\ ^ r),G^(Y ti+j , l<i<v, \j\ 

where fM : M l, ( 2 '' +1 ) -> R and : M v ( 2r+1 ) -> R. Under the assumption r < [Jfc/2], 
we use the £ = r| or X-weak dependence of Y in order to bound this covariance term 
by \|/(LipF( r ',LipG' r ',M(2r + l),v(2r + l))£,t-2r, with respectively \\f(u,v,a,b) = 
ua + vb or \\f(u,v,a,b) = uvab + ua + vb. We compute 



LipF 



(» 



sup 



\f(H(x Si+l , 1 < i < «, |/| < r) - f(H(y Si+l , 1 < / < «, |/| < r) 



where the sup extends to x ^ y where x,y G W'( 2r+1 \ Notice now that if x,y are 
sequences with x\ = y, = if |/| ^ r then repeated applications of the condition 
(2.4) yields 

(4.17) \H(x)-H(y)\ < £ y,| <L £ y f | 

where L = Y^iez^i- Repeating inequality eqn. (4.17), we obtain 

|FW(x)-F«Cy)|<Up/Lf £ |x, J+ /-y, i+ /| 

1=1 -r<l<r 
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and we get Lip/ 7 ''') ^ Lip/L. Similarly LipG^ ^ LipgL. 



Under r|-weak dependent inputs, we bound the covariance 



Cow(f(X s ),g(X t ))\ 



< ( M Lip/ + vLipg) x 2 £ bi\\Y \U + {2r+ \)Lx\ Y (k-2r) 



Under X-weak dependent inputs 



Cov(f{X s ),g(X t ))\ sC ( M Lip/ + vLipg + wvLip/Lip^)x 

x ({2 £ fe/||y ||l + (2r+ l)LX Y (k-2r)}v 




4.6. Proof of Lemma 3.2. 

4.6.1. Existence. We decompose X as above in the case I = 0. Here, we bound 
each terms by 



Hence assumptions t + 1 ^ m' and Y*iez \ < 00 together imply that the variable 
H(Y) is well defined in L 1 . In the same manner, the process X n = H(Y n _i, i G Z) is 
well defined. The proof extends in L'" if m ^ 1 is such that (I + \)m ^ m' . 

4.6.2. Weak dependence properties. Here, we exhibit some Lipschitz functions 
and we then truncate inputs. We write Y = Y V (-T) A T for a truncation T set 
below. Denote X„ {r) = H(Y^) and X® = H(Y {r) ). Furthermore, for any k ^ 
and any (u + v)-tuple such that s\ < ■ ■ • < s u ^ s u + k ^ t\ < • • • < t v , we set X s = 



(X Sl ,XJ, X t = (X tl ,... ,X tv ) and X?> = (<\ . . . x[ r} = (<\ . . . 



Then we have for all f,g satisfying ||/||<», ||g||oo ^ 1 and Lip/ + Lipg < 00 



\H(YW)-H(0)\ ^ b \Y \ 

H(YW)-H(Y®)\ < MllifllLvi)^ 

\H(Y^)-H(Y^\ < ^.(||FW||Lvl)|y| 



Using Holder inequality yields 



E H(Y^)-H(0) +£E H(Y ( - s+ ^)-H(Y!f ) ) 



+e h(yI s) )-h(y^) ^£2|/|^(l|yoiii + i|yoii!:i) 



(4.20) 



(4.18) 



(4.19) 



Cov(f(X s ),g(X t ))\ < |Cov(/(X s )-/(Xf),g(X t ))| 

+ \Coy(f(X { s r) ),8(X t )-g(X { t r) ))\ 
+ |Cov(/(x; r) ),g(jW))|. 
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Using the fact that ^ 1, the term (4.18) is bounded by 



2m Lip/ ( max E 

1 <i<u 



X Sj — X s , 



+ max E 

1 <l <K 



With the same arguments used in the proof of the existence of H(Y ( -°°^), the first 
term in the right-hand side of the inequality is bounded by 

£2|/|^(||F ||i + ||Fo||;t!). 

Notice now that if x,y are sequences with Xf = y, = if |/| ^ r then an infinitely 
repeated application of the previous inequality (2.4) yields 

(4.21) \H( X )-H(y)\^L(\\xtv\\yt\/l)\\x-y\\ 

where L = Yiez^i < 00 because Y,iez H^' < °°- The second term is bounded by 
using eqn. (4.21) 



E 



xP-x? 



H[Y^]-H[Y 



E 



< LE max 



- ,,,)' E ^) 

«S L(2r+1) 2 E( max |y ; |'|y/|U| F .|> r J 



^ L{2r+l) 2 \\Y \\^T e+1 - m ' 

The second term (4. 19) of the sum is analogously bounded. The last term (4.20) 
can be written as 

Cov (T {r) (Y Si+j , 1 < i < u, \j\ ^ r),G (r) (Y ti+h 1 < i < v, |j| < r) 

where F W : ]R l, ( 2 '' +1 ) -► R and G W : EH 2r+1 ) -> R. Under the assumption r < 
[fc/2], we use the £ = r\ or X-weak dependence of F in order to bound this covari- 
ance term by \|/ 1 LipF ,LipG ,u(2r+ l),v(2r+ 1) ) 8^_2 r , we set respectively 



LipF W 



V|/(w, v, a, b) = uvab or \|/(m, v, a, Z?) = «va& + ua + vb. 

\f(H(x Si+l , l^i^u, \l\ < r)-f(H(y s . +l , 1 < i < «, |/| < r) 



sup- 

E"=iR-yjll 

where the sup extends to (xi, . . . / (yi, . . . ,)>„) where x,,^- e ]R 2r+1 . Using 
eqn. (4.21) 

\F {r \x)-F {r \y)\ SC Lip/if {\\x Si \\~V\\y Si \\„Vl) l \\x s -y Si \\ 

1=1 

< Lip /Lr'£ £ |x Jj+ /-y Si+/ |. 

(=1 -r<l<r 
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We thus obtain Lip ^LipfLT 1 . Similarly Lip ^ Lipg LT l . 
Under r|-weak dependent inputs, we bound the covariance 



|Cov(/(X s ),g(X t ))|<(«Lip/+vLipg){4£ |iNro||i + ||io|lSl) 

+ (2r + 1)L ((2r + l)2||yo||™>' +1 " m ' + - 2r)) } 

We then fix the truncation T m _1 = — - — — to obtain the result of Lemma 

t\ r (k-2r) 

3.2 in the rj-weak dependent case. 
Under X-weak dependent inputs 

\Cov(f{X s ),g(X t ))\ ^ ( M Lip/ + vLips + M vLip/Lips)x 
x({4£|i|MI|yo||i + ||IbO 

\i\> 

+ {2r + \)L {l{2r+ l)r ,+1 -'"'||yo||^ + T%(k-2rj) } 

{(2r+l) 2 L 2 T 2 %(k-2r)}) 



V 



/ 2\\Y II 

We then set a truncation such that T I+m '~ l = - . — - to obtain the result of 

Lky (k — 2r) 

Lemma 3.2 in the r|-weak dependent case. □ 
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